Principal components: A descent algorithm

نویسندگان

  • Rebeca Salas-Boni
  • Esteban G. Tabak
چکیده

Many frequently arising problems involve finding the small-dimensional subspace that best captures the variablity of a set of observations belonging to a larger space, for example, finding its principal components. We propose an algorithm that finds this subspace through a series of orthogonal rotations, each represented as the exponential of a skew-symmetric matrix picked such that we minimize the cost function associated to our problem.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Principal Component Analysis for Sparse High-Dimensional Data

Principal component analysis (PCA) is a widely used technique for data analysis and dimensionality reduction. Eigenvalue decomposition is the standard algorithm for solving PCA, but a number of other algorithms have been proposed. For instance, the EM algorithm is much more efficient in case of high dimensionality and a small number of principal components. We study a case where the data are hi...

متن کامل

GOYAL & VETTERLI : ADAPTIVE TRANSFORM CODING USING LMS - LIKE . . . 1 Adaptive Transform Coding UsingLMS - like Principal Component

A new set of algorithms for transform adaptation in adaptive transform coding is presented. These algorithms are inspired by standard techniques in adaptive nite impulse response (FIR) Wiener ltering and demonstrate that similar algorithms with simple updates exist for tracking principal components (eigenvectors of a correlation matrix). For coding an N-dimensional source, the transform adaptat...

متن کامل

Robust Transfer Principal Component Analysis with Rank Constraints

Principal component analysis (PCA), a well-established technique for data analysis and processing, provides a convenient form of dimensionality reduction that is effective for cleaning small Gaussian noises presented in the data. However, the applicability of standard principal component analysis in real scenarios is limited by its sensitivity to large errors. In this paper, we tackle the chall...

متن کامل

Real Time On-chip Sequential Adaptive Principal Component Analysis for Data Feature Extraction and Image Compression

In this paper, we present a new, simple, and optimized hardware architecture sequential learning technique for adaptive Principal Component Analysis (PCA) which will “help optimize the hardware implementation” in VLSI and to overcome the difficulties of the traditional gradient descent in learning convergence and hardware implementation. To demonstrate the performance of our algorithm, we study...

متن کامل

Adaptive Transform Coding Using LMS-like Principal Component Tracking

A new set of algorithms for transform adaptation in adaptive transform coding is presented. These algorithms are inspired by standard techniques in adaptive nite impulse response (FIR) Wiener ltering and demonstrate that similar algorithms with simple updates exist for tracking principal components (eigenvectors of a correlation matrix). For coding an N -dimensional source, the transform adapta...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • J. Comput. Physics

دوره 267  شماره 

صفحات  -

تاریخ انتشار 2014